Tradeoffs between the excess-code-length exponent and the excess-distortion exponent in lossy source coding
نویسندگان
چکیده
Lossy compression of a discrete memoryless source (DMS) with respect to a single-letter distortion measure is considered. We study the best attainable tradeoff between the exponential rates of the probabilities that the codeword length and that the cumulative distortion exceed respective thresholds for two main cases. The first scenario examined is that where the source is corrupted by a discrete memoryless channel (DMC) prior to reaching the coder. In the second part of this work, we examine the universal setting, where the (noise-free) source is an unknown member of a given family . Here, inspired by an approach which was proven fruitful recently in the context of composite hypothesis testing, we allow the constraint on the excess-code-length exponent to be -dependent. Corollaries are derived for some special cases of interest, including Marton’s classical source coding exponent and its generalization to the case where the constraint on the rate of the code is relaxed from an almost sure constraint to a constraint on the excess-code-length exponent.
منابع مشابه
An Information-Theoretic Study on Variable-Length Source Coding with Unequal Cost
– Abstract – In the variable-length source coding, we may consider vary zestful problem as follows: If each code symbol is given prescribed cost to transmit or record, what code is optimal? This problem is substantial from not only theoretical viewpoints but also engineering points of view. Because, in practical systems of communication or recording , it may reasonable to consider unequal costs...
متن کاملOptimum Tradeoffs Between the Error Exponent and the Excess-Rate Exponent of Variable-Rate Slepian-Wolf Coding
We analyze the asymptotic performance of ensembles of random binning Slepian-Wolf codes, where each type class of the source might have a different coding rate. In particular, we first provide the exact encoder excess rate exponent as well as the decoder error exponent. Then, using the error exponent expression, we determine the optimal rate function, namely, the minimal rate for each type clas...
متن کاملJoint Source–Channel Coding Excess Distortion Exponent for Some Memoryless Continuous-Alphabet Systems
We investigate the joint source–channel coding (JSCC) excess distortion exponent (the exponent of the probability of exceeding a prescribed distortion level) for some memoryless communication systems with continuous alphabets. We first establish upper and lower bounds for for systems consisting of a memoryless Gaussian source under the squared-error distortion fidelity criterion and a memoryles...
متن کاملThe Reliability Function of Lossy Source-Channel Coding of Variable-Length Codes with Feedback
We consider transmission of discrete memoryless sources (DMSes) across discrete memoryless channels (DMCs) using variable-length lossy source-channel codes with feedback. The reliability function (optimum error exponent) is shown to be equal to max{0, B(1−R(D)/C)}, where R(D) is the rate-distortion function of the source, B is the maximum relative entropy between output distributions of the DMC...
متن کاملOn the Joint Source-Channel Coding Excess Distortion Exponent for Memoryless Continuous-Alphabet Systems
We investigate the joint source-channel coding (JSCC) excess distortion exponent EJ (the exponent of the probability of exceeding a prescribed distortion level) for memoryless communication systems with continuous alphabets. We first establish upper and lower bounds for EJ for systems consisting of a memoryless Gaussian source under the squared-error distortion fidelity criterion and a memoryle...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
- IEEE Trans. Information Theory
دوره 48 شماره
صفحات -
تاریخ انتشار 2002